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In 1990 the Commission on Health Research for Development advanced the concept of Essential 
National Health Research (ENHR) as a strategy for promoting health and development on the 
basis of equity and social justice!. The Commission envisaged ENHR as a mechanism: 


e to provide and update the scientific knowledge base required for decision-making in the field 
of health and for priority setting: 


e to ensure the best use of available resources; and 


e to promote research into difficult and unresolved problems especially where existing techniques 
were considered inadequate even to reduce the problems to manageable proportions. 


Based on the Commission’s recommendations the Council on Health Research for Development 
(COHRED) was established in 1993 to advance and promote the ENHR strategy. To make research 
more effective, its work is based upon the following three principles.? 


e Put country priorities first; 

e Work for equity in health; and 

e Link research to action for development 
To implement the ENHR strategy several competencies have been identified, as follows:34 
e Promotion and advocacy 

e Building an innovative mechanism 

e Priority setting 

e Capacity building 

e Resource mobilisation 

e Research into action and policy 

e Community involvement 

e Networking and coalition building 


e Evaluation 
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This manual is a guide to one of those competencies, namely research priority setting using the 
ENHR strategy. It covers the following specific aspects of priority setting: 


Preparatory work by the team convening the priority setting exercise; 
Elements of priority setting; 
Criteria for priority setting; 


Follow-up activities after identifying broad priority areas; 


Cine ee er 


Implementation. 


Throughout the manual the core principles of putting local/country concerns first, working towards 
equity, and linking research to action are emphasised as a basis for priority setting. 


Why set research priorities? 

e to channel resource allocation, as well as donor investment in health, to areas of highest 
priority; 

e to address the issue of equity; 


e _toattend to the needs of the most vulnerable groups of the population (e.g., women, children, 
the poor) 


e to reinforce the links between research, action and policy; 


e because the research priorities we set today determine the health agenda, practices and 
technologies of tomorrow”. » 


What is unique about research priority setting using the ENHR 
strategy? 


It is a systematic approach to identifying research priorities characterised by: 


e _ inclusiveness; 


e involvement of a broad range of stakeholders, such as researchers, health care providers and 
representatives of the community; 


e multidisciplinary and cross-sectoral approach; 

e partnership development; 

e participatory and transparent processes; and 

e systematic analyses of health needs, societal and professional expectations. 


The underlying values of the ENHR strategy for priority setting follow the three basic principles of 


ENHR: putting country priorities first; working for equity in development; and linking research to 
action for development. 


Why is this learning module needed? 


ania: the Process of research priority setting on the basis of the COHRED document 
.J: Essential National Health Research and Priority Setting: lessons learned ©. 


UU 
Section One 


Who is this learning module prepared for? 


Instructors or facilitators running a research priority setting workshop using the ENHR strategy. 


What does this learning module actually do? 


It provides instructors or facilitators with a ste 


p by step guide for participants in a research priority 
setting workshop, 


leading to the successful completion of the process. 


What does this learning module not do? 


It does not impose on the facilitators or participants any particular method or criteria for research 
priority setting. It is vital that participants take decisions by consensus at each step of the process. 


Who is expected to participate in an ENHR priority setting 
workshop? 


The participants represent ENHR stakeholders, i.e. researchers, decision-makers at various levels, 
health service providers and communities. Private sector participants are equally important (for 


example, professional associations or the pharmaceutical industry), as well as parliamentarians, 
potential donors and international agencies. 


What sort of information is used during the workshop? 


Priority setting in any situation, no matter how well resourced or otherwise, must “start with what 
you have”. The objective is to combine effectively descriptive, analytical and evaluative information 
with the ideas, perceptions and emphases of ENHR stakeholder groups, including the public at 
large. 


Introduction 3 


SS tree aint ms 
wine duftztly Pi 


Section 2 


Preparatory work by the team 
convening the priority setting 
arias exercise 


Dee ve 
me we 
“usar a7eu PRIOR\W “ax, 
SESEARCH AREAS 


Before embarking on the exercise of priority setting it is important for the convenor to recognise 
that priority setting itself is a component of the ENHR process as a whole. In other words priority 
setting cannot be undertaken in isolation from the other elements of the ENHR process. It is 
equally important to understand that there is no one simple meaning of the priority concept. The 
real question is priority for whom? The health needs of humanity are holistic and legion, as too 
are research opportunities. Every government, people and institution has its own notion of “priority”, 
serving its own purposes, within its sense of mandate, capacity, culture and resources. The scientific 
community is motivated by the pursuit of intellectual opportunity, but it can be enticed to mobilise 
and direct its efforts and energies, if it is made aware of the needs and priorities of others 7. 
Furthermore, priority setting should not be seen as a one-off event. It is an iterative and interactive 
process, in which each step is influenced by results from those that precede it. 


2.1. Steps involved in the preparatory work 


2.1.1. Leadership Creation 


Leadership is needed to harness the potential of other prospective partners. At the country level, 
the authorities might designate a focal point to provide leadership for ENHR, but other national 
arrangements are possible (for details, see: How to boost the impact of country mechanisms to 
support ENHR: a peek into the melting pot of country experiences: COHRED document 99. 1°). 
At the local level the convenor may need to identify suitable leadership. For the process to succeed 
it is important that the leadership be: 


e acceptable to all major stakeholders; 

e a motivating factor with firm conviction; 

e committed to ENHR; 

e knowledgeable as to how and where to access information and resources; and 


e able to develop a grasp of existing stakeholder groups and civil leadership at different levels. 


9.1.2. Awareness raising 


The following steps need to be taken: 


i i develop an understanding of 
Conduct open meetings with various groups and stakeholders to 
what cin is all about. (A primer on ENHR is found in COHRED document 2000.2: Health 
research: powerful advocate for health and development, based on equity’.) 


SSeS 
Preparatory Work = 


rch and how it can be used to solve existing 
eate a demand for research. 


and groups to understand why they 
d how they operate. 


e Discuss the concept of essential health resea 
health problems. The aim at this stage is to cr 


e Hold informal discussions with important institutions 
exist. whom they represent, what activities they organise an 


e Discuss with leaders of different levels (civil society, NGOs and professionals) how research 


could be of value to their work. 


eVisit domestic/local health service agencies and NGOs to ascertain the available secon 
information on health, some of which will be used later. The main purpose at this stage is to 


identify sources of information. 


condary 


9.1.3. Reaching agreement with stakeholders 


e Determine areas and modalities of cooperation with various stakeholders and groups. 


e Draw-up a work-plan/time frame with group leaders for the process of research priority 
setting. 

e Facilitate the formation of new groups where appropriate, especially among marginalised 
sectors of society. 

e Facilitate the formation of a Working Group from a cross-section of stakeholders to deal with 
research priority setting 


e Facilitate meetings of the Working Group to assume roles and responsibilities, and reach 
agreement on a workplan for research priority setting. 


2.1.4. Planning for priority setting 


e Stage planning meetings with the Working Group to 
formulate objectives and tasks to be accomplished. 


e Work out the methods to be used in defining the research 
agenda/ priorities. 


e Solicit the resources needed for the exercise. 


e Submit proposals to funding agencies (government, NGOs, 
others). 


e Develop linkages with competent government departments. 


e Present the plans to the authorities and enlist their support 
and endorsement. 


2.2. Practical suggestions 


The process of preparing a country for a priority setting exercise can be extremely complex and 
ag time should, therefore, be allowed. The preparatory stage may take up to 3 —- 6 months. 

he priority-setting exercise is certainly not a one-day, hurriedly organised national workshop. All 
kinds of problems may occur in practice, such as: 


e It may not be easy to identify and involve all the important stakeholders. It is essential to 


my. with people or institutions like NGOs and government bodies that have already 
established particularly good contacts with the community. In some cases, church groups and 
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fieldworkers would also be important (see Box 1). It is always a good idea to keep political 
decision-makers and/or government bodies well informed about what you are doing, and 
discuss with them ways of mobilising the community. 


Box 1: Using field workers to penetrate the community 


In Senegal, regional, district,and health centre personne! participated in the design 
of a Community nutrition intervention to improve infant feeding practices in the 
Fatick Region. Discussions with these field workers helped to identify personnel 
and groups in the community as the best potential educators. The operations 
research design was then built around field-workers’ sense of which interventions 
would be most suitable for them to try out and later replicate. 


Adapted from: Porter RW & Prysor-Jones S, 1997° 


e It may not be easy to identify the most appropriate agencies to represent the interests of the 
lay community, and the best method of approaching the community and sustaining its interest. 


A solution to this problem may lie in understanding the nine basic principles for community 
involvement !°: 


- Participation by all, including marginalised groups 

- Voluntary involvement 

- Democratic practices 

- Transparency 

- Learning from reflection 

- Flexibility 

- Organised groups 

- Partnership between the people, NGOs and government representatives 


A number of approaches to elicit community inputs are contained in Box 2. 


Box 2: Approaches to obtaining community inputs 


a a ae 


Deliberated User consultation Focus Group Discussions 


(FGDs) 


From: Jordan Jet al., 1998" 


Panels 


Questionnaire surveys Opinion surveys of 


standing panels 


Written information 
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Checklist Preparatory work by the team convening the priority setting 


exercise 


priority setting? Is the entire ENHR strategy 


1, Isthe country/state/district ready for 
ty setting been 


and process adequately understood? Has the need for oriori 
explicitly stated? 
e if so, what is the evidence? 


e = If not, why not? 

2. Have the key groups and constituencies been identified and contacted? 
Particular care should be taken to ensure that vulnerable groups and the lay 
community are represented. 

3, Is there enough support from political decision-makers, government bodies 
and NGOs? 

If so, in what form? What is the evidence? 


A. Dothe groups represented understand the key elements of the ENHR strategy? 
These elements are: inclusiveness and partnership; focus on equity in research; 
transparency; consultative processes. 


5. Arethere enough background documents on health statistics, socio-economic 
profile and prior research information? 


ls there credible leadership? 
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Elements of priority setting 
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3.1. Identification of stakeholders 


Groups of stakeholders who should be involved in setting research priorities, besides researchers 
themselves, are potential users and the people affected by the research results. Countries that 


have had experience in priority setting using the ENHR strategy have generally identified four 
categories of participants: 


e researchers; 
e decision-makers at various levels; 
e health service providers; and 


e communities. 


It is important to appreciate the fact that each interested group - researchers, health policy makers, 
health care providers, and the population at large - has a different perspective on issues that need 
the most urgent attention. 


e Researchers tend to focus on their disciplinary interest and may often base the choice of 
subjects on research trends in developed countries. 


e Health care providers frequently face practical problems, some of which demand urgent 
solutions. 


e The public at large often has little information on which to base sound judgement. A small but 
noisy elite that disregards the wishes of the poor and other marginalised groups may dominate 
it. 


The convenor must ensure that the perspectives of the various groups are reconciled. 


3.1.1. Practical suggestions 


The involvement of a broad range of stakeholders in ENHR is a key element of the priority- 
setting exercise. The essential points to bear in mind are: 

e Know the participants: who and where they are, their needs and interests, their expectations, 
their relative strengths and weaknesses, and supportive and obstructive forces around them. 
This is where the convenor could use information from the early dialogues among the groups 
at the preparatory stage. 

Allow adequate time for the above-mentioned preparatory stage in order to understand the 


population dynamics, and eventually to identify the key groups and institutions to be included 
in the priority-setting exercise. It is important to remember that the process of identifying the 


partners is very time-consuming. 
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e Avoid falling into the trap of limiting the choice of stakeholders 
to those in the capital city, in centrally located institutions, 
and in the headquarters of the Ministry of Health. 


e Every effort must be made to tap the resources of stakeholders 
from the countryside as well. 


e In most developing countries it is just not possible to ignore 
the role of donors and international agencies, both in setting 
health policy priorities and in the implementation of major 
health programmes. Equally important in influencing public policy is the growing role of the 
private sector, as well as parliamentarians. They must all be brought on board. 


Checklist Identification of Stakeholders 


Are the interests of all partners represented? 


Among the researchers are various disciplines represented, e.g., biomedical 
sciences, economics, other social sciences, education, public health? 


Are the policy makers adequately represented? 
lf so, what level of representation? 


Are you happy with the quality of representation? Usually the top decision- 
makers are too busy. They may choose to send people who are too junior for 
effective decision-making. 


lf not, what mechanism do you have to ensure credible representation from 
the top? 


Are the private sector and NGOs adequately represented? It may be 
necessary to obtain a listing of all private health care providers and NGOs 
working in health to ensure adequate representation. 


Is there sufficient community representation? Avoid the trap of accrediting 
an elite minority that ignores the needs of the poor, illiterate, women, children 
and other disadvantaged groups. 


3.2. Situation analysis 


Situation analysis/stocktaking broadens the understanding of all participants, and provides a picture 
of the current state of affairs, which may differ from that of the stakeholders. Situation analysis 
must be systematic and scientific, involving the assessment of: 


e health status 

e health systems 

e health research systems 

e userfelt needs (wants) 

e user demands (expressed needs) and values 


The assessment must take equity as its overriding concern. 
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3.2.1. Practical suggestions 


Information from situation analysis often lays the foundation for rational decision-making on 
priorities. It is important to bear in mind that: 


e not all health problems are disease-focused. Consider also risk factors. 
e not all important health problems are leading causes of morbidity and mortality. 
e emphasis must be put on health problems of marginalised groups. 


e some problems might have a serious impact on health in the future. 


Box 3 outlines the major issues that must be covered in conducting a situation analysis. 


Box 3: Issues to be considered in situation analysis 


Health status 


What is the country’s state of health? (Selected impact indicators) 


e What are the main health problems? (Morbidity /mortality statistics, national 
prevalence surveys, disability-adjusted life years, quality-adjusted life years, 
databases and systematic reviews of health research) 


Health care system 


e What are the main health problems? (health personnel? health programme 
planning? programme implementation/management? health facilities/ 
infrastructure? health care supplies?) 


e What is the National/District Health Plan? (Primary health programmes at the 
national/district level? How was the health plan developed, and by whom?) 


Health research system 


e What research has been done or is currently undertaken? (What areas of 
research are being addressed; who is doing the work; where is the work being 
done?) 

e What are the sources of funding (Who funds the research; how much money 

is granted to different kinds of research; who takes the decisions?) 


3.3. Identification of research areas 


The aim at this stage is to draw up initial lists of research areas that emerge from situation analysis 
and inputs from various stakeholders. Building consensus on the criteria to be used and a system 


EEE 
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of scoring for items that figure on the list is usually the best way to start. Techniques for consensus 
building include: 

e brainstorming sessions 

e multi-voting 

e nominal group technique 

e roundtable discussions 


e prioritisation matrices 
Details and examples of these techniques can be found in COHRED Document 97.3? and in The 
Memory Jogger by Brassard & Ritter *’. 


Checklist Issues to be considered in siuation analysis 
ls there information on vital statistics? (infant mortality rate, child mortality rate, 
crude death rate, maternal mortality rate, immunisation coverage, etc.) 

2. What are the common health problems affecting the population? 

3. Isthere anational or district health plan that addresses major health problems? 
4 


—_ 


Has any health research been done here before? 
e  |fso, on what and what did it show? 
e What is the current research gap? 
5. How is the health care system organised? 
6. What are the major problems affecting the health care system? 
7 


Which are the main vulnerable and disadvantaged groups in the population? 
And what are their health concerns? 


Does the proposed problem require health action or research? 
e ls there sufficient knowledge to address the problem? 
e What are the research gaps? 


e What types of research are needed? (strategic and basic research; clinical 
research; behavioural and social science research; cost-effectiveness analysis; 


health technology assessment; health policy and systems rese 
: arch. See 
COHRED Document 97.3 °) : 


What particular research areas can be identified? 


See 
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Section 4 


Criteria for priority setting 


Once a broad list of research areas has been agreed upon, many further rounds will be necessary 
to reduce it to a manageable list of priorities. The first consensus-building exercise might result in 
a provisional list of priority health problems or broad research issues, which needs to be channelled 
into clearly defined areas of research. This section gives an overview of possible criteria for priority 
setting and an option for a relatively simple method of scoring or weighting them. The choice of 
criteria and the scoring system may differ, depending on the level or stage of priority setting. 
There are other more complicated methods, such as prioritisation matrices, some of which require 
the use of formulae and grids. (see COHRED Document 97.3 6) 


Za 4.1. Create the list of criteria 


Y__ Brainstorm on the list of criteria or review available 
documents or guidelines. (See Box 4.1) 


Tip: Use the focus group discussion technique, 
round-table discussions or the nominal group 
technique, as described in Section 5 of the 
COHRED document 97.3 for the brainstorming 


process. 
/Y _ Eliminate duplicates from the list. 
Y Clearly define / clarify the meaning of each 
criterion. 


Tip: The clarifying statement should be written in 
a format that can be quantitatively scored at the 
next stage. (See Box 4.2) 


Za 


4.2. Group the selected criteria into 

representative categories 

vy Name the categories to represent themes addressed 
in the priority setting process. 


Tip: Descriptions should clarify the scope of each 
of the criteria. Box 4.3 can be taken as an example. 


vy Assign all the selected criteria to the appropriate 
categories. 
Tip: Use Box 4.4 as an example. 


Box 4.1. Examples of criteria 
used in health research 
priority setting 


1. Adequacy and usefulness of the 

current knowledge base (avoiding 

duplication) 

Applicability of the research 

outcome 

Availability of cost-effective 

interventions 

Capacity of the system to carry 

out the research 

Community concern/demand 

Economic impact 

Environmental health and socio- 

political effects 

Equity focus 

. Ethical and moral issues 

10. Feasibility 

11.Funding support 

12.Human rights issues 

13.Impact on health 

14.|Impact on development 

15. Justification of the cost/investment 

16. Justification of time 

17.Legal aspects 

18.Magnitude of the problem 

19,Obligation and professional 
responsibility 

20.Operational effectiveness 

21.Partnership building 

22.Persistence of the problem 

23.Political will/ acceptability/ 
commitment 

24,Relevance 

25.Responsiveness to the National 
Health Policy or national goals 

26.Research capacity building 

27.Research utilisation 

28.Urgency 
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Box 4.2. (cont) Examples of a clarifying statement for each of the criteria 


efulness of the current knowledge base (avoiding 


Adequacy and us 
duplication) 


> How adequate and useful is any available r 
this topic? 

2. Applicability of the research outcome 

> Whatis the probability that the expected research outcome can be applied 
to informed decision-making? 

3. Availability of cost-effective interventions 

> Howavailable are the existing cost-effective interventions to address the health 

problem? 

Capacity of the system to undertake the research 


How adequate is the capacity of the system to undertake the research in 
terms of competency, infrastructure, support system, mechanisms and 
resources? ; 


esearch-based information on 


> 


5. Community concern/demand 


> How much does the research topic resoond to community concern or 
demand? 


Economic impact 


> Will the planned research topic provide significantly more cost-effective 
interventions compared to the existing ones? 


7. Environmental health and socio-political effects 


>» What are the negative implications for environmental health or socio-political 
effects? 


Equity focus 


> How much does research in this area contribute to greater equity in health in 
socio-demographic terms, economic status, health service access/delivery, 
gender, etc.? 


9. Ethical and moral issues 


» Is the planned research ethically and morally acceptable? 
10. Feasibility 


» How feasible is the planned research, considering available resources? 
11. Funding support 


> How likely is it that the project will receive funding? 
12. Human rights issues 


Is there a possibility that this research topic violates any human rights issue? 
13. Impact on health 


What impact will this research have on the health of the population? 
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Box 4.2. Examples of a clarifying statement for each of the criteria 


. Impact on development 


What impact will this have on the overall development of the country? 
15. Justification of the cost/investment 


» How justifiable is the cost of running this research project? 
16. Justification of time 


How justifiable is it to spend this amount of time on this research project? 
17. Legal aspects 


» Is there a chance that a component of the research topic is illegal in the 
country? 


18. Magnitude of the problem 


» What is the size of the problem? Many indicators can be used, such as 
prevalence, incidence, severity, disability, mortality, morbidity, years of 
potential life lost, disability-adjusted life years, healthy days of life lost, quality- 
adjusted life years, trends in disease profile, biophysical burden, economic 
burden and social burden. 


19. Obligation and professional responsibility 


» Are there any societal obligations and professional responsibilities for this 
problem? 


20. Operational effectiveness 


> How workable is the planned operation/management of the research? 
21. Partnership building 


> What is the probability that partners from various disciplines or sectors will 
collaborate to undertake the research? 


. Persistence of the problem 
> How persistent is the burden of the disease in question? 
23. Political will/ acceptability/ commitment 


> Whatis the likelihood that the research topic will be endorsed, approved and 
supported by the competent policy makers? 


24. Relevance 

> How relevant is the research topic to the health needs of the community? 

25. Responsiveness to the National Health Policy or national goals 

> To what extent does the research question respond to the National Health 
Policy or national goals? 


26. Research capacity development 


> How much does research in this area contribute to building, strengthening or 
sustaining research capacity in the country or sub-national and district levels? 
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Box 4.2. (cont) Examples of a clarifying statement for each of the criteria 


27. Research utilisation 


> Whatare the chances of the outcome reco 
and the project being sustained? 


mmendations being implemented 


28. Urgency 
> How urgent are the data needed for decision making? 


Box 4.3. Examples of categories for grouping selected criteria by theme 


Category 1: Appropriateness - Should we do it? 

> The theme of this category is whether the proposed research is well suited to 
the target society and whether it does not duplicate past studies. 

> The key question for this category is “Should we do it?” 


Category 2: Relevancy - Why should we do it? 


> The theme is to ensure that the proposed research is the right kind for the right 
people, and that it is pertinent to the health problems of the Community, 
without disregarding equity issues. 


> The key question is “Why should we do it?” 
Category 3: The Chance of success - Can we do it? 
» The theme is to assess the strength and resources of the research team 


» The key question is “Can we do it?” 


Category 4: Impact of the research outcome - What will the 
stakeholders get out of it? 


» The theme is to estimate the benefit of using or implementing the research 
results, and evaluate the merit and usefulness of the research outcome. 


» The key question is “What will the stakeholders get out of it?” 
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Box 4.4. Examples of criteria that can be grouped by theme 


Category 1: Appropriateness - Should we do it? 


>» The theme of this category is whether the Proposed research is well suited to 
the target society and whether it duplicates past studies. 


» The key question for this Category is “Should we do it?” 


> Criteria that can be grouped into this category are: ethical and moral issues, 
human rights issues, legal aspects, political acceptability and commitment of 


the responsible policy-makers, adequacy and usefulness of the current 
knowledge base. 


Category 2: Relevancy - Why should we do it? 


» The theme is to ensure that the Proposed research is the right kind for the right 
people, and that it is pertinent to the health problems of the community, 
without disregarding equity issues. 


» The key question is “Why should we do it?” 


> Criteria that can be grouped into this category are: community concern/ 
demand, magnitude of the problem, severity of the problem, trends of the 
problem, responsiveness to the national health policy or national goals and 
with heavy emphasis on equity as the basis of ENHR strategy. 


Category 3: The chance of success - Can we do it? 


The theme is to assess the strength and resources of the research team 


>» The key question is “Can we do it?” 


> Criteria that can be grouped under this category are: capacity of the system 
to undertake the research, cost justification, time justification and funding 
support. 


Category 4: Impact of the research outcome - What do the 
stakeholders get out of it? 


The theme is to estimate the benefit of using or implementing the research 
results, and evaluate the merit and usefulness of the research outcome. 


> The key question is “What will the stakeholders get out of it?” 


> Criteria that can be grouped under this category are: research utilisation, 
health impact or the public health significance, economic impact and 


development impact. 
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4.3. Assign score choices to all the criteria 
ach of the criteria. 


Tip: The number of score choices ranges normally from two to five. Taking ecitenon of 
Economic impact as an example: Will the planned research topic provide significantly 


. . . . . a 
more cost-effective interventions compared to existing ones: 


v Assign the number of score choices to e 


Economic impact (with 4 score choices) 
Very low impact 


Economic impact (with 2 score choices) 
4 Low impact 


QO High impact 1 Low impact 
1 High impact 
Economic impact (with 3 score choices) Q Very high impact 
4) Low impact 
O Medium impact Economic impact (with 5 score choices) 
Q High impact O Very low impact 


(1 Low impact 
1) Moderate impact 
1) High impact 
QO Very high impact 


vy Assign a point score to each choice. 


Tip: Beginning with one point for the first choice, each following choice usually scores one 
point more than the preceding choice. The scores can be a positive or negative number. 


Positive scores with an increment of 1 point per item. 


Economic impact (with 2 score choices) Economic impact (with 4 score choices) 
1 Low impact 1 Very low impact 
2 High impact 2 Low impact 
3 High impact 
Economic impact (with 3 score choices) 4 Very high impact 
1 Low impact 
2 Medium impact Economic impact (with 5 score choices) 
3 High impact 1 Very low impact 


2 Low impact 
3 Moderate impact 
4 High impact 
5 Very high impact 


a 
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Positive and negative scores with an increment of 1 point per item. 


Economic impact (with 2 score choices) 
-1 Low impact 
+1 High impact 


Economic impact (with 4 score choices) 
-2 Very low impact 

-1 Low impact 

+1 High impact 

Economic impact (with 3 score choices) +2 Very high impact 

-1 Low impact 


O Medium impact Economic impact (with 5 score choices) 

+1 High impact -2 Very low impact 
-1 Low impact 

0 Moderate impact 

+1 High impact 

+2 Very high impact 


/’ Decide if any of the criteria should be used as screening criteria in order to 
discard some of the proposed research areas from the list. 


Tip: Criteria such as adequacy and usefulness of the current knowledge base, ethical and 
moral issues, human rights issues and legal aspects may be considered screening criteria. 
Using the criterion of Ethical and moral issues as an example: Is the planned research 
ethically and morally acceptable? 


Ethical and moral issues 


Q Unacceptable 

1 Debatable, Equivocal 

2 Sensitive issue 

3 No foreseeable problem 

If a research topic scores zero for this criterion, it should be dropped from the list 


/ Decide if any of the criteria should be divided into subsets. 


Tip: Some of the criteria have more than one aspect to consider. For example, the criterion 
Research utilisation, which has been defined as What is the probability that the research 
outcome/recommendations will be implemented and the project sustained? This has two 
aspects for consideration, e.g. the implementation of the recommendations and sustainability 
of the project. Ideally, this criterion should have two subsets for scoring. (See the following 


example.) 


Research utilisation - What is the probability that the research recommendations will 
be implemented and the project sustained? There are two subsets in this criterion: 
QO Probability of implementation Q) Sustainability of the project 


3 Likely 
3 High a 
; 2 Difficult to predict 
F t 
2 Fair, Moderate ; ie 


1 Low or None 
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P 4A, Assign a scoring system 


‘Decide if all criteria should have equal or different weighting. 


Tip: There are several methods of weighting’*’, hence there must be consensus within the 


group on how to weight the criteria. 
y Decide if the score for a criterion with subsets should be the average or total of 
the subset scores. 


Tip: lf it is agreed to use the total instead of the average score for criteria with subsets, these 
criteria are assigned greater weight than criteria without subsets. In the example below the 
average system is used and the score for the criterion of Research utilisation is three or less. 


Research utilisation - What is the probability that the research recommendations will 
be implemented and the project sustained? (There are two subsets in this criterion. The 
score for this criterion is the average of the subsets shown to one decimal point.) 


Q Probability of implementation Q Sustainability of the project 
3 High 3 Likely . 
2 Fair, Moderate 2 Difficult to predict 


1 Low or None 1 Unlikely 


/ Choose between addition or multiplication for the scoring system’*””. 


Tip: In the addition system scores for all of the criteria are added up and the total is used for 
ranking the research topics. The higher the score, the higher the priority. In the multiplication 
system the total score is arrived at by multiplying the scores together. The multiplication 
scoring system should not be used with negative number choices. Zero number scores can be 
used in the multiplication scoring system only if the criteria with a zero number score are 
designated as screening criteria. 


© 4.5. Test the module 


/ Produce a first draft of the prioritisation module. 


Tip: You may wish to use Annex 1, Comprehensive Module: an example of using criteria 
for research priority setting. 


/ Test the module on one or two research topics, with participants working as a 
group or individually. | 


Tip: Record the average time taken to finish the module for one research topic. Multiply the 
average time by the number of research topics to be prioritised to get a rough estimate of the 
total time needed to complete the process. Record the difficulties and discrepancies among 
participants in applying each criterion and score choice to the research topic. Let the group 
decide if the module produced is suitable for the task, or needs to be modified. 


/ Compare the weighting for each category. 


Tip: Use the total score for each category for comparison. Point out to the group that 
categories with a higher score receive greater weighting. 
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© 4.6. Modify the module 


/ 


Weighting each category. 


Tip: Let the group decide if each category should be given equal or different weighting. If the 
consensus is for equal weighting then the total score for each category must be the same. Use 
the category with a minimal total score as the baseline for other categories. 


Discard less important criteria. 


Tip: Let the group decide on what the total score should be and then ask which criteria and 
categories should be discarded. 


Produce a final draft of the prioritisation module. 


Tip: You may wish to use Annex 2, Abbreviated Module: an example of using criteria for 
research priority setting. 


"Za 4.7. Double check the module 


J 


Test the final draft module with the same one or two research topics, with all 
participants working as a group or individually. 


Tip: Record the average time used to finish the module for one research topic. Multiply the 
average time by the number of research topics to be prioritised to get a rough estimate of the 
total time needed to complete the process. Record too the difficulties and discrepancies among 
participants in the process of applying each criterion and score choice to the research topic. 
Let the group decide if the module produced is suitable for the task or if it needs to be 
modified. 


eC 4.8. Produce a working module 


J 


Produce a working module for the prioritisation process. 


Tip: This working module is a miniature of the final draft module. For ease of use, the module 
is meant to occupy no more than one page. See Annex 3, Miniature Module: an example of 
using criteria for research priority setting. 


& 49. Finish the process of research prioritisation 


/ 


A 


/ 


Score each research topic using the working module. 


Write down all the scores 


Rank the research topics by their scores. 
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There are three major reasons why there must be follow-u 
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a Follow-up to the identification of 
broad research priority areas 


tay “Practed 9 


p action after identifying the broad 


Experience elsewhere shows that the priority setting exercise, however well organised, will 
initially only produce broad areas of research priority. 


Priority setting will raise a lot of expectations, especially among researchers, who expect 


funds to be made immediately available so that the ideas included in the research agenda 
might materialize. 


Some people will very often be disappointed by the feeling that their ideas have not been 
accommodated, or that they were not fully involved in the exercise. 


The follow-up activities include: 


Research problem specification — carried out primarily by a core group and/or task force 
designated for that purpose. 


Translation of research areas into specific research questions. One approach to this task is to 
invite researchers to prepare ‘concept papers’, which describe proposed research projects for 
specific priority problem areas agreed upon by consensus among the stakeholders. If this 
approach is followed, it is best to prepare guidelines for the concept papers. For a given 
problem area the research projects should be specified in terms of objectives, methods of 
addressing the problem, and the resources needed. 


Publication and dissemination of the priority research agenda. Priority ideas discussed at the 
priority-setting meeting should be published and every effort must be made to disseminate the 
information as soon as it is practicable. It may be necessary to convene a national workshop 
to circulate the information gathered and to elicit additional inputs that could be used to 


amend the research agenda. 
Identify resource requirements (government, donors, NGOs, etc). 
Determine time lines. 


Identify potential research groups for implementation. 
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Checklist Follow-up t 


o the identification of broad research priority 
areas 


Was the analysis for identifying and prioritising research objective? 

How many people/groups were involved? 

What were their contributions? 

Who were not involved? 

ls the research agenda specific enough to guide donors and researchers? 
Does the research agenda address equity in health? 


What percentage/number of projects address health problems of vulnerable 
groups or the poor? 

Will the agenda divert resource flows towards equity-targeted programmes? 
What mechanisms have been put in place to disseminate the research agenda 
itself? An organised dissemination mechanism will usually serve as a powerful 
advocacy tool. The distribution of resources and effort across the spectrum of 
health problems appears to reflect uneven advocacy and special pleading, 
rather than national and co-ordinated response to need”’. 


How much interest has the agenda generated among stakeholders (donors, 
government and researchers)? 
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ee a Implementation 


In considering the implementation of the research agenda the following issues must be addressed: 


Building and facilitating interdisciplinary and multi-stakeholder teams. One of the 
key features of ENHR is to promote interdisciplinary and cross-sectoral research. The planning 
team should synthesise the ideas generated from the concept papers and work towards bringing 
researchers in different fields together as a team to work on related research areas. 


Identification of resources by priority area. Identifying resources to implement the 
research agenda can be frustrating. Various countries have tried different approaches, such as 
organising a donors’ conference to sell the research agenda: encouraging government support 
for the research agenda (by creating a research budget in the MOH); and by encouraging 
seasoned researchers to focus their efforts on priority areas. 


Research protocol development. Poor “grantsmanship” is a common problem in most 
developing countries. It would be worthwhile to organise help for researchers to develop their 
ideas to qualify for research grants. The planning team should be able to solicit the necessary 
technical support for this purpose. 


Establishment of a peer-review process and a forum for revision. Leave room for 
critical review of the priority-setting process and flexibility in updating the research agenda. 
Acute health problems and issues may emerge; new research findings may suggest new 
approaches to health problems; or new health or economic trends may dictate new research 
needs and opportunities. The research agenda must be dynamic and responsive to changing 
times and circumstances. 


A mechanism for monitoring and evaluation of research work. Our concern here is 
not just to monitor and evaluate the process of implementing the research agenda, but also to 
review the impact of health research. The primary goal of monitoring is to serve as an early- 
warning system, to indicate whether the combined effect of research is producing policies 
that will promote equity in health. Monitoring should raise questions for further investigation 
into ways of achieving equity in health; and should ideally be an ongoing assessment of how 
different social groups are faring in absolute terms as well as the order of magnitude of the 
gap between groups. It should be remembered that setting priorities is value-intensive; 
stakeholders in the process must guard against hidden agendas and motives that run counter 
to the ENHR principle of giving country priorities and equity paramount consideration. 


Dissemination of research findings. This could be through workshops, publications in 


reviewed journals, policy briefs and other appropriate types of research reports. In addition, 


oes provide information and feedback to patients or the 


researchers should be careful to 
communities involved in their research. 
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e Utilisation of research results. To ensure that research results are put to good use jit is 


important to: 


- facilitate dialogue between researchers and policy/decision makers; 


- translate research results into policy briefs; 
- disseminate research results to a wide public through mass media. 


RED Document 99.1: How to boost the impact 


For details and other approaches, see COH } 
R: a peek into the melting pot of country 


of country mechanisms to support ENH 
experiences °. 


6.1. Practical suggestions 


The main task is to identify indicators. They must be selected through a process that involves the 
appropriate range of participants. A range of indicators is needed to reflect important aspects of 
health and its major determinants. This will include indicators of health status, as well as health 
care indicators (which must reflect key aspects of health care, e.g., indicators of health care 
financing, allocation of health care resources, utilisation of health services, and quality of health 
services). Multiple indicators should ideally be examined to explore the way in which conclusions 
about equity vary according to different indicators. 


6.1.1. Indicators 

e Does the research agenda address equity in health? 
-  percentage/number of projects addressing problems of vulnerable groups or the poor. 
- diversion of resource flows towards equity-targeted programmes. 
- diversion of resource flows towards research agenda/priorities, etc. 


e Utilisation: how much interest has the agenda generated among stakeholders (donors, 
government agencies, and researchers)? 


e Input from multiple stakeholders: how many people/groups were involved — who were not 
involved? 


e ls there a forum for stakeholders to share information and evaluate the process? 


I 
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ANNEX 1 
The Full Module 


How to use criteria for research priority setting 


Category 1 
Appropriateness: 
Should we do it? 


Category 2 
Relevancy: 
Why should we do it? 


Category 3 
The chance of success: 
Can we do it? 


Category 4 


Impact of the research outcome: 
What do the stakeholders get out of it? 
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Category 1: Appropriateness 
total score Ly 15 


riteria that participants should agree on as a way of 
listing. The purpose of the category is to determine 
ety and if it duplicates past studies. The 


inappropriate _) 


This category addresses the crucial screening C 
excluding certain research topics from priority 
if the proposed research is well suited to the target soci 
key question is “Should we do it?” 


Instructions: Enter the score for each criterion in the box provided. If a criterion has subsets, 
each should be scored separately and the average used for the criterion as a whole. The scores for 
each criterion are then added up and put in the total score box at the beginning of the category. 
The number to the right of the box indicates the maximum possible score for the category. 


The research topic should be discarded if any of the criteria in the category gets a zero score. The 
box labelled “inappropriate” should be ticked and the total score ignored. 


Ea Ethical and moral issues Is the planned research ethically and morally 


No foreseeable problem acceptable’ 


a 

2 Sensitive issue 

1 Debatable, Equivocal 
0 Unacceptable 


J Human rights issues Is there a possibility that this research topic 


ees 
Respects violates any human rights issue: 


5 

2 Satisfies 
1 = Infringes 
0 Violates 


L) Legal aspects Is there a chance that a component of the 
3 Lawtul research topic is illegal in the country? 
2  Justifiable 
1 Improper 
O Wrongful 


a Political acceptability and commitment of What is the likelihood that the research topic 


the competent policy-makers will be endorsed, approved and supported by 
3 LIENS be endorsed the competent policy makers 
2 Neutral 


1 Uncertain 
QO Unlikely to be supported 


30 Annex 


LJ Adequacy and usefulness of the current 


How adequate and useful is any available 
knowledge base 


research-based information on this topic? 


(The score for this Criterion is the avera 


ge of the scores below carried to one decimal place. 
An average of less than 1 counts as 0. 


The criterion has 3 subsets.) 


L) Availability of pre-existing data 


None in existence 
Scarce, Inadequate 
Fair, Moderate 
Abundance 


Ore DM W 


L) Validity of pre-existing data 


Unusable for target population 
Unlikely to be applicable 
Sound 


Very convincing 


Or WM W 


J Reliability of pre-existing data 


3 Inaccurate, Misleading 
2 Weak, Suspicious 
1 = Strong 


Example of the outcome of this exercise is: Should we do it? 


We should not, because it is ethically unacceptable or it violates human rights issues, or is legally 
wrongful, or bot likely to be supported by the Ministry of Public Health. It is also a waste of human 
and Paancial resources because there is an abundance of valid and reliable existing data to be 


used. 


f the criteria used in the remaining 
. There is no zero score item in any fe) 
a8 ories, because the research topics have already been judged ea 
Be eetingin the screening criteria of Category 1.They can thus only be discarde 


through the ranking process 
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Category 2: Relevancy 
total score LY 21 


The purpose of this category is to make sure the proposed research is the right kind for the right 
people, and is pertinent to the health problem of the community without ignoring equity issues. 


The key question is “Why should we do it?” 


Instructions: Enter the score for each criterion in the box provided. If the criterion has subsets, 
each should be scored separately and the average used for the criterion. The scores for each 
criterion are then added up and put in the total score box at the beginning of the category. 


LL Community concern/ demand How much does the research topic serve the 
3 High community concern or demand? 
2 Moderate 


1 Lowor None 


L) Commonality/prevalence/ incidence How common is the problem in terms of 
3 High prevalence and incidence? 
2 Moderate 


1  Lowor None 


a Severity of the problem How severe is the problem to the health of the 
3. High community in terms of morbidity and mortality? 
2 Moderate 


1  Lowor None 


) Trends of the problem How are the trends of the problem? 
3 Rising 
2 Stable 
1 Falling 


J Responsiveness to the national health policy How much does the research question respond 


or national goals to the National Health Policy or national goals? 
3 Elgin 
2 Moderate 


1  Lowor None 
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) Urgency How urgently is the data needed for decision 
3 Very urgent making? 
2 Urgent 
1 Not urgent 


a Equity focus How much does the research in this area 
3 High contribute to greater equity in health in terms 
2 Mederate of socio-demographic, economic, health service 
A beurcr None access/ delivery and gender etc.? 


Example of the outcome of this exercise: Why should we do it? 


We should do it, because the community is very concerned and demands a solution. We already 
know that the problem causes high morbidity, and that future trends suggest an increase. Although 
the problem has been addressed in the National Health Policy, it persists. Because of the high 
mortality rate, research to help identify solutions is urgently needed. Moreover, because it is in the 
common interest of all stakeholders, it contributes to equity in health development. 
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Category 3: The chance of success 


total score Ly 12 


The purpose of this category is to evaluate the strength and resources of the prospective research 


team. The key question is “Can we do it?” 


Instructions: Enter the score for each of the criteria in the box provided. If the criterion has 
subsets, each should be scored separately and the average used for the criterion. The scores for 
each criterion are then added up and put in the total score box at the top of the page. 


LI) Capacity of the system to undertake the How adequate is the capacity of the system to 
research undertake the research in terms of competency, 
infrastructure, support system, mechanisms and 

resources? 


(The score for this criterion is the average of the scores below carried to one decimal place. 
The criterion has 4 subsets.) 


I) Competency 

3. Excellent 

2 Good 

1 = Fair or Poor 
L) Infrastructure 

3 Excellent 

2 Good 


1 ‘Fair or Poor 


LI) Support system and mechanisms 


3 Excellent 
2 Good 
1 Fair or Poor 


L_) Resources 


3 Excellent 
2 Good 


1 ‘Fair or Poor 
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LL) Cost justification How justifiable is the cost of running this 
3. Exceptional research project? 
2 Good 


1‘ Fair or Poor 


J Time justification 


How justifiable is the amount of time to be used 
3 Very Appropriate in implementing this research project? 

2 Acceptable 

1 Unclear, Uncertain 


L) Funding support How likely is it that the project will receive 
3 Very likely funding? 
2 Possible 
1 Doubtful 


Example of the outcome from this exercise: Can we do it? 


The research can definitely be done because there are competent research teams available; the 
institutions have adequate infrastructure; the support systems and mechanisms to fulfil the tasks 
are excellent; and other resources are readily available. The estimated cost of the project is justifiable 
and the time frame to carry out the research is appropriate. Several funding agencies have shown 
interest in supporting the project. 
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Category 4: Impact of the research outcome 


total score Ly 12 


te the benefit of using or implementing the research 


The purpose of this category is to estima 
Iness. The key question is “What do the stakeholders 


results, and assessing their merit and usefu 
get out of it?” 


Instructions: Enter the score for each of the criteria in the box provided. If the criterion has 
subsets, each should be scored separately and the average used for the criterion. The scores for 
each criterion are then added up and put in the total score box at the beginning of the category. 


L} Research utilization What are the chances of the recommendations 
being implemented and the project being 
sustained? 


(The score for this criterion is the average of the scores below carried to one decimal place. 
The criterion has 2 subsets.) 


J Chances of implementation 


3. ~ Gligh 
2 Fair, Moderate 
1  Lowor None 


L) Sustainability of the project 


3 Likely 
2 _ Difficult to predict 
1 Unlikely 
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L) Health impact or the 


ssa! public health How much impact will this research have on 
significance 


health of the population? 


(The score for this criterion is the a 


capi verage of the scores below carried to one decimal place. 
The criterion has 4 subsets) 


cS Coverage of the target population 


S  Fligh 
2 ‘Fair, Moderate 
1 Poor or None 


_} Overall reduction of the burden 


3 ‘High 
2 Fair, Moderate 
1 Poor or None 


L) Future health impacts 


3. High 
2 Fair, Moderate 
1 Poor or None 


*Special Instruction: Score only one of the following 3 items. 


J Problem-solving perspective 


3. High 
2 Fair, Moderate 
1 Poor or None 


LI Preventability of the problem 


3 High 
2 Fair, Moderate 
1 Poor or None 


_) Quality aspects (products/ technology/ 
systems/ resources) 


Sueebtigh 
2 Fair, Moderate 
1 Poor or None 


ly one issue. A problem-solving project might not look 


iects address on 
* Most research proje To score all three together and use the average 


into prevention and quality aspects. 
score would not be appropriate. 


——————————— 
Annex 37 


LJ Economic impact 
(The score for this criterion is the average of the scores below carrie 
The criterion has 2 subsets.) 


d to one decimal place. 


I) Cost savings of the intervention 
compared to existing ones 

3 High 

2 Fair, Moderate 

1 Poor or None 


a National expenditure savings if the Will the planned research topic provide 
research is fully implemented significantly more cost-effective interventions 
9 “Hien compared to existing ones? 


2. Fair, Moderate 
1 Poor or None 


LI Development impact How much impact will this research have on 
research capacity building? 


(The score for this criterion is the average of the scores below carried to one decimal place. 
The criterion has 2 subsets.) 


L] Partnership building (probability that interdisciplinary partners may 
3 High collaborate to undertake the research) 
2 Fait 


1 Poor or None 


L) Research capacity building (researchers/ health managers/ health staff/ 
3. High community members) 
2 ‘Far 


1 Poor or None 


irae ie of the outcome of this exercise: “What do the stakeholders get 
out of it?” 


The outcome of the project has a good chance of being implemented and is likely to be sustainable. 
This is because the research has focused on the preventability of the problem. It offers a high 
coverage of the target population and can thus reduce a sizeable amount of the burden, although 
it may only moderately address future health impacts of this condition. The recommendation will 


make significant savings for the public and at the same time strengthen research capacity and 
team development. 


ee 
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The Full Module 


Summary Sheet 


Research Topic 
ee See rifts See 


Category 1: Appropriateness 


inappropriate ) total score Ly 15 


If the research topic is inappropriate, the priority setting exercise for this topic is discontinued. 
Otherwise, the total score for each category should be entered below. 


Category 2: Relevancy total score Ly 21 
Category 3: The chances of success total score LY 12 
Category 4: Impact of the research outcome total score LY 12 


Aggregate Score Ly 60 
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ANNEX 2 
The Short Module 


How to use criteria for research priority setting 
Category 1 


Appropriateness: 
Should we do it? 


Category 2 


Relevancy: 
Why should we do it? 


Category 3 


The chance of success: 
Can we do it? 


Category 4 


Impact of the research outcome: 
What do the stakeholders get out of it? 
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Category 1: Appropriateness 
total score L) / 6 


This category addresses the crucial screening criteria that participants should agree on as a way of 
excluding certain research topics from priority listing. The purpose of the category is to determine 
if the proposed research is well suited to the target society and if it duplicates past studies. The key 


question is “Should we do it?” 


inappropriate L} 


Instructions: Enter the score for each of the criteria in the box provided. The scores for each 
criterion are then added up and put in the total score box at the top of the page. The research 
topic should be discarded if any of the criteria in this category gets a zero score. The box labelled 
“inappropriate” should be ticked and the total score ignored. 


a Ethical and moral issues Is the planned research ethically and morally 


> 
No foreseeable problem acceptable: 


a 

2 Sensitive issue 

1 Debatable, Equivocal 
0 Unacceptable 


LI Availability of pre-existing data How adequate is any available research-based 


. . ‘ m4 . ° B 
3 None in existence information on this topic: 


2 Scarce, Inadequate 
1 Fair, Moderate 
QO Abundance 


N. B. There is NO zero score item in any of the criteria used in the remaining 
categories, because the research topics have already been judged worth 


considering in the screening criteria of Category 1.They can thus only be discarded 
through the ranking process 
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The purpose of this Category is to make sure that the 
right people, and is pertinent to the health problem 
issues. The key question is “Why should we do it?” 


Category 2: Relevancy 


total score Ly 6 


proposed research is the right kind for the 
of the community without ignoring equity 


Instructions: Enter the score for each of the criteria in the box provided. The scores for each 
criterion are then added up and put in the total score box at the beginning of the category. 


L) Equity focus and community concern/ How much does research in this area contribute 


demand 


3 High 
2 Moderate 
1  Lowor None 


L) The burden of illness 


3. High 
2 Moderate 
1  Lowor None 


to better equity in health and serve the 
community concern or demand? 


What is the size and severity of the problem? 
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Category 3: The chance of success 


total score Ly 6 


The purpose of this category is to evaluate the strength and resources of the prospective research 


team. The key question is “Can we do it?” 


Instructions: Enter the score for each of the criteria in the box provided. The scores for each 
criterion are then added up and put in the total score box at the beginning of the category. 


L) Capacity of the system to undertake the How adequate is the capacity of the system to 
undertake the research in terms of competency, 


research 
3 Excellent paesate support system, mechanisms and 
2 = Good s 
1 Fair or Poor 
J Cost justification How justifiable is the cost of running this 


3. Exceptional research project? 


2 Good 
1 = Fair or Poor 
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Category 4: Impact of the research outcome 


total score Ly 6 


g or implementing the research 
ess. The key question is “What do the stakeholders 


The purpose of this category is to estimate the benefit of usin 
results, and assessing their merit and usefuln 
get out of it?” 


Instructions: Enter the score for each of the criteria in the box provided. The scores for each 
criterion are then added up and put in the total score box at the beginning of the category. 


L) Chances of implementation What are the chances of the recommendations 


3 High being implemented? 
2 Fair, Moderate 
1 Lowor None 


L) Overall reduction of the burden including How much impact will this research have on 
cost health of the population? 
3. High 
2 Fair, Moderate 
1 Poor or None 


Se ee ee 
Se ng nee en ee eee eee eee enn eee ene nnn ee en eee ele 
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The Short Module 


Summary Sheet 


Research Topic —__$_$_$_$_$_{?_—_—___{_ rr rrr 


Category 1: Appropriateness 


inappropriate L) total score LY 6 


If the research topic is inappropriate, the priority setting exercise for this topic is discontinued. 
Otherwise, the total score for each category should be entered below. 


Category 2: Relevancy total score LY 6 
Category 3: The chances of success total score LY 6 
Category 4: Impact of the research outcome total score LY 6 


Aggregate Score LY 94 
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ANNEX 3 


Mini-module 


How to use criteria for research priority setting 


Instructions: For each of the criteria bel 
in the box to the left of the title. Add u 
box at the bottom of the page. 


ow, enter the appropriate score for the research topic 
p all the scores and write the total in the aggregate score 


Category 1: Appropriateness. Should we do it? 


a Ethical and moral issues J Availability of pre-existing data 


3 No foreseeable problem 3 None in existence 


2 Sensitive issue 2 Scarce, Inadequate 

1 Debatable, Equivocal 1 Fair, Moderate 

O Unacceptable (If this item is QO Abundance (If this item is chosen, 
chosen, the research topic should be the research topic should be discarded) 
discarded) 


Category 2: Relevancy. Why should we do it? 


LI Equity focus and community concern/ LL) The burden of illness 


demand 3 Hen 
3. High 2 Moderate 
2 Moderate 1  Lowor None 


1  Lowor None 


Category 3: The chance of success. Can we do it? 


L) Capacity of the system to undertake the L) Cost justification 


research 3 Exceptional 
3. Excellent 2 Good 
a escd 1 ‘Fair or Poor 


1 ‘Fair or Poor 


Category 4: Impact of the research outcome. What do the stakeholders get 
out of it? 


L) Chances of implementation LJ Overall reduction of the burden, including 
cost 
S- = Fligh 
2 Fair, Moderate ; ere 
ai 
1 Lowor None ; 


1 Poor or None 


Aggregate score I24 
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